Automated Lip-Sync for 3D-Character Animation
نویسندگان
چکیده
A central task for animating computer generated characters is the synchronization of lip movements and speech signal. For real time synchronization high technical effort, which involves a face tracking system or data gloves, is needed to drive the expressions of the character. If the speech signal is already given, off-line synchronization is possible but the animator is left with a time consuming manual process that often needs several passes of fine tuning. In this paper we present an automated technique for creating the lip movements of a computer-generated character from a given speech signal by using a neural net. The net is trained by a set of pre-produced animations.
منابع مشابه
Animating Lip-Sync Characters
Speech animation is traditionally considered as important but tedious work for most applications, especially when taking lip synchronization (lip-sync) into consideration, because the muscles on the face are complex and interact dynamically. Although there are several methods proposed to ease the burden on artists to create facial and speech animation, almost none are fast and efficient. In thi...
متن کاملA Conversational Avatar Framework for Digital Interactive StoryTelling
Digital Interactive Storytelling (DIS) is a relatively novel area of computer entertainment which aims at investigating interactive applications capable of generating consistent, emergent and rich stories. To provide new solutions for DIS, we have proposed a novel multi-agent DIS framework, DIEGESIS, which includes agents' coordination and new planning and replanning solutions for DIS. A natura...
متن کاملAutomated lip-sync: Background and techniques
The problem of creating mouth animation synchronized to recorded speech is discussed. Review of a model of speech sound generation indicates that the automatic derivation of mouth movement from a speech soundtrack is a tractable problem. Several automatic lip-sync techniques are compared, and one method is described in detail. In this method a common speech synthesis method, linear prediction, ...
متن کاملA Talking Head System for Korean Text
A talking head system (THS) is presented to animate the face of a speaking 3D avatar in such a way that it realistically pronounces the given Korean text. The proposed system consists of SAPI compliant text-to-speech (TTS) engine and MPEG-4 compliant face animation generator. The input to the THS is a unicode text that is to be spoken with synchronized lip shape. The TTS engine generates a phon...
متن کاملLips-Sync 3D Speech Animation using Compact Key-Shapes
Facial animation is traditionally considered as important but tedious work for most applications, because the muscles on face are complex and dynamically interacting. Although there are several methods proposed to ease the burden from artists to create animating faces, non of these are fast and efficient in storage. This paper introduces a framework for synthesizing lips-sync facial animation g...
متن کامل